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Abstract 



We continue the study of robust reductions initiated by Gavalda and 
Balcazar. In particular, a 1991 paper of Gavalda and Balcazar Q claimed an 
kS ' optimal separation between the power of robust and nondeterministic strong 

C^ ■ reductions. Unfortunately, their proof is invalid. We re-establish their theorem. 

Generalizing robust reductions, we note that robustly strong reductions 
are built from two restrictions, robust underproductivity and robust 
overproductivity, both of which have been separately studied before in 
other contexts. By systematically analyzing the power of these reductions, we 
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explore the extent to which each restriction weakens the power of reductions. 
We show that one of these reductions yields a new, strong form of the 
Karp-Lipton Theorem. 



1 Introduction 

The study of the relative power of reductions has long been one of central 
importance in computational complexity theory. Reductions are the key tools used 
in complexity theory to compare the difficulty of problems. When we say that A 
reduces to B, we informally interpret this to mean "A is roughly easier than B" 
where the "roughly" regards a certain tolerance that reflects the power or flexibility 
of the reduction. To understand precisely the complexity of a problem, we must 
understand the nature of this tolerance, and thus we must understand the relative 
power of reductions. 

Beyond that, reductions play a central role in countless theorems of complexity 
theory, and to understand the power of such theorems we must understand the 
relationships between reductions. For example, Karp and Lipton |l^ proved that 
if SAT Turing-reduces to some sparse set then the polynomial hierarchy collapses. A 
more careful analysis reveals that the same result applies under the weaker hypothesis 
that SAT robustly-strong- reduces to some sparse set. In fact, the latter result is 



simply a relativized version of the former result [0, though the first proofs of the 



latter result were direct and quite complex ||l,T^. As another example, in the present 
paper — but not by simply asserting relativization — we will note that various theorems, 
among them the Karp-Lipton Theorem, indeed hold for certain reductions that are 
even more fiexible than robustly strong reductions. 

In this paper, we continue the investigation of robust reductions started by 
Gavalda and Balcazar M. We now briefiy mention one way of defining strong 



reduction [^JT^] and robustly strong reduction 0]. Definition p. 1| provides a formal 
definition of the same notions in terms of concepts that are central to this paper. We 
say that a nondeterministic Turing machine is a nondeterministic polynomial-time 
Turing machine (NPTM) if there is a polynomial p such that, for each oracle A and 
for each integer n, the nondeterministic runtime of A^"^ on inputs of size n is bounded 
by p{n). (Requiring that the polynomial upper-bounds the runtime independent of 
the oracle is superfiuous in the definition of <|^, but may be a nontrivial restriction 
in the definition of <t^; see the discussion of this point in Section p. The definitions 
used here agree with those in the previous literature.) Consider NPTMs with three 
possible outcomes on each path: ace, rej, and ?. We say A strong-reduces to B, 
A <T^ B, if there is an NPTM A^ such that, for every input x, it holds that (a) if 
X & A then N^{x) has at least one ace path and no rej paths, and (b) ii x ^ A 



then N^{x) has at least one rej path and no ace paths. (Note that in either case the 
machine may also have some ? paths.) Furthermore, we say A robustly strong-reduces 
to B, A <5^ B, if there is an NPTM N such that A <f^ B via A^ (in the sense of 
the above definition) and, moreover, for every oracle O and every input x, N'^i^x) is 
strong, i.e., it either has at least one ace path and no rej paths, or has at least one 
rej path and no ace paths. This paper is concerned with the relative power of these 
two reductions, and with reductions whose power is intermediate between theirs. 

In particular, it is claimed in |^ that the following strong separation holds with 
respect to the two reductions: 

For every recursive set A ^ NP fl coNP, there is a recursive set B such 
that A strong-reduces to B but A does not robustly strong-reduce to B [0, 
Theorem 11]. 

Unfortunately, there is a subtle but apparently fatal error in their proof. One of 
the main contributions of this paper is that we re-establish their sweeping theorem. 
Note that the zero degrees of these reducibilities are identical, namely the class NP fl 
coNP [0. Thus, in a certain sense, the above claim of Gavalda and Balcazar is optimal 
(if it is true, as we prove it is), as if A G NP fl coNP then A strong- reduces to every 
B and A also robustly strong- reduces to every B. 

Section |^ presents our proof of the above claim of Gavalda and Balcazar. The proof 
is delicate, and is carried out in three stages: First, we establish the result for all A G 
EXP-(NP n coNP), where EXP = Ufc>oDTIME[2"']. Here, the set B produced from 
the proof is not necessarily recursive. Second, we remove the restriction of A G EXP, 
by showing that if the result fails for A ^ EXP then indeed A G EXP, yielding a 
contradiction. The proof so far only establishes the existence of some B, which is not 
necessarily recursive. Finally, with the certainty that some B exists, we can recast 
the proof and show that for every recursive A a recursive B can be constructed. We 
mention to the reader the referee's comment that PD| is an antecedent of our proof 
approach. 

The notion of "robustly strong" is made up of two components — one stating 
that for all sets and all inputs the reducing machine has at least one non-? path, 
and the other stating that for all sets and all inputs the reducing machine does 
not simultaneously have aee and rej paths. Each component has been separately 
studied before in the literature, in different contexts (see Section H). By considering 
each of these two requirements in conjunction with strong reductions, we obtain 
two natural new reductions whose power falls between that of strong reductions and 
that of robustly strong reductions. Section ^ studies the relative power of Turing 
reductions, of strong reductions, of robustly strong reductions, and of our two new 
reductions. In some cases we prove absolute separations. In other cases, we see that 
the relative computation power is tied to the P = NP question. Curiously, the two 




Figure 1: Inclusions of Proposition 2.3 



new reductions are deeply asymmetric in terms of what is currently provable about 
their properties. For one of the new reductions, we show that if it differs from Turing 
reductions then P 7^ NP. For the other, we prove that the reduction does differ from 
Turing reductions. 

In Section 5, we discuss some issues regarding what collapses of the polynomial 
time hierarchy occur if sparse sets exist that are hard or complete for NP with respect 
to the new reductions. One of the new reductions extends the reach of hardness 
results. 



2 Two New Reducibilities 



For each NPTM N and each set D C S*, define outj^D{x) = {y\ y G 
{acc,rej, ?} A some computation path of N^{x) has outcome y}. As is standard, 
for each nondeterministic machine N and each set D C E*, let L{N^) denote the 
set of all X for which ace G out]yD{x). For each nondeterministic machine N and 
each set D C S*, let Lrp.j{N^) denote the set of all x for which rej G outjqD{x). 



^rej\ 



A computation N (x) is called underproductive if {ace, rej} ^ out]^D{x). That is, 
N^{x) does not have as outcomes both ace and rej. A^'^ is said to be underproductive 
if, for each string x, N^{x) is underproductive. That is, L{N^) fl Lrej{N^) = 0. 
Underproductive machines were introduced by Buntrock [Q. Allender et al. 
have shown underproductivity to be very useful in the study of almost-everywhere 
complexity hierarchies for nondeterministic time classes. 

A computation N^{x) is called overproductive if outj^jo^x) ^ {?}. A machine 



is overproductive. 



A^'^ is said to be overproductive if, for each string x, N^{x) 
Equivalently, L{N^) U LrejiN^) = S*. 

We say that A^ is robustly overproductive if for each D C S* it holds that A^^ 



is overproductive. We say that A^ is robustly underproductive if for each D C S* it 
holds that A^^ is underproductive. 

Using underproductivity, overproductivity, and robustness, we may now define 
strong and robustly strong reductions, which have been previously studied. We also 
introduce two intermediate reductions, obtained by limiting the robustness to just 
the overproductivity or the underproductivity.[] 

Definition 2.1 

1. /H^/, see also /[7|/ ("strong reductions") A <^ B if there is an NPTM N 
such that N^ is overproductive, N^ is underproductive, and A = L{N^). 

2. /0/ ("robustly strong reductions") A <^^ B if A <^ B via an NPTM N , 
and N is both robustly overproductive and robustly underproductive. 

3. ("strong and robustly underproductive reductions" or, for short, "U -reductions") 
A <T B if A <^ B via an NPTM N that is robustly underproductive. 

4. ("strong and robustly overproductive reductions" or, for short, "O -reductions") 
A <T B if A <^ B via an NPTM N that is robustly overproductive. 

The trivial containment relationships are shown in Proposition |2.3| and Figure |l[ 
In this paper we ask whether some edges of the diamond pictured in Figure ^ might 
collapse, and in particular we seek necessary conditions and sufficient conditions for 
such collapses. 

Notation 2.2 For each well-defined reduction <^, let <^ denote {(A, 5) | A <^ B}. 

Proposition 2.3 <^ C <^^ ^ ^g ^ ^sn 

Using different terminology, robust underproductivity (though not <^) has been 
introduced into the literature by Beigel (0, see also 0), and the following theorem 
will be of use in the present paper. 

Theorem 2.4 (^, see also J^) If NPTM N is robustly underproductive, then 
(VA)(3L G pS^T®^)[L,e,(iV^) C L C L{W)]. 



^The literature contains various notations for strong reductions (also known as strong 
nondeterministic reductions). We adopt the notation of Long's paper |1^, i.e., <^ . However, 
we note that some papers use other notations, such as <^^, <™, and <5^' '^'^° . For the three 
other reductions we discuss, we replace the SN with a mnemonic abbreviation. For robustly strong 
we follow Gavalda and Balcazar |j] and use RS. For brevity, we use O as our abbreviation for our 
"strong and robustly overproductive" reductions, and we use U as our abbreviation for our "strong 
and robustly underproductive" reductions. 



Theorem p.4| says that if a machine is robustly underproductive, then for every 
oracle there is a relatively simple set that separates its acceptance set from its L^ej 
set. In particular, if P = NP and A^ is a robustly underproductive machine, then for 
every oracle A it holds that L{N^) and Lrej{N^) are P'^-separable. 

As is standard, we say that a set S is sparse if there is a polynomial r such that, 
for each n, \\S-"'\\ < r{n). Using different terminology, "robust with respect to sparse 
sets"-overproductivity (though not <^) has been introduced into the literature by 
Hartmanis and Hemachandra 0, and the following theorem will be of use in the 
present paper. 

Theorem 2.5 /||/ // NPTM N is such that for each sparse set S it holds that N^ 
is overproductive, then for every sparse set S there exists a predicate b computable in 

FP denotes the polynomial-time computable functions. 

Theorem |2.5| says that if a machine is "robustly with respect to sparse oracles" - 
overproductive, then for every sparse oracle there is a relatively simple function that 
for each input correctly declares either that the machine has accepting paths or that 
the machine has rejecting paths. Crescenzi and Silvestri show via Sperner's Lemma 
that Theorem p.5| fails when the sparseness condition is removed, and their proof 
approach will be of use in this paper. 

It is known that SN reductions and RS reductions have nonuniform 
characterizations. In particular, for every reducibility <\ and every class C, let 

K{C) = {A\{3BeC)[A<iB]}. 

Gavalda and Balcazar proved the following result. 
Theorem 2.6/0/ 

1. R|^ (SPARSE) = NP/poly n coNP/poly. 

2. R?S(SPARSE) = (NP n coNP)/poly. 

We note in passing that the downward closures of the sparse sets under our two 
new reductions have analogous characterizations, albeit somewhat stilted ones. We 
say A G NP/poly fl coNP/poly via the pair (M, A^) of NPTMs if there is a sparse 
set S such that A = L{M^) and A = L{N^). Hartmanis and Hemachandra |0 
defined robustly J]* -spanning pairs of machines (M, A^) to be pairs having the property 
L{M^) U L{N^) = S* for every oracle X, and robustly disjoint pairs to be pairs 
having the property L{M^) r\L{N^) = for every oracle X. Using these notions we 
note the following characterizations. A G R^ (SPARSE) if and only if A G NP/poly fl 
coNP/poly via some robustly S*-spanning pair (M, A^) of NPTMs. A G R^(SPARSE) 
if and only if A G NP/poly fl coNP/poly via some robustly disjoint pair (M, A^) of 
NPTMs. 
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3 A Strong Separation of <^ and <^^ 

It follows from each of Section H's Theorems [4.2| and [4.8|, both of which have 



relatively simple proofs, that the reducibilities <^ and <^^ are distinct. However, 
more can be said. The separation of these two reductions turns out to be extremely 
strong, namely, for every recursive set A ^ NP n coNP, there exists a recursive set 
B such that A is strongly reducible to B but A is not robustly strong reducible to 
B. This is Theorem p.4| . As noted in Section |I], this claim cannot be generalized to 
include NPflcoNF since NPflcoNF is the zero degree of <x^, as has been pointed out 
by Gavalda and Balcazar 0. Theorem p.4| was first stated in Gavalda and Balcazar's 
1991 paper 0. The diagonalization proof given there correctly establishes A ^^^ B, 
but it fails to establish A <^ B. The main error is the following: In the proof there 
is a passage 0, p. 6, lines 21-25] where a certain word x is searched for. If such an 
X is found, then B is augmented by some suitably chosen word (triple). Now it is 
true that such an x must always exist. However, it might be huge, and then between 
this X and the previous one, say x', no coding has been done, i.e., for all z between 
x' and X, no triple {z,y,0) or {z,y, 1) with \z\ = \y\ has been added to B. Thus, the 
condition "(i)" of [0, p. 6], which is intended to guarantee A <^ B, is violated. 



We now turn towards the proof of Theorem p.4| . However, we first prove the 
following claim. 

Theorem 3.1 (V recursive A ^ NP n coNP)(35)[A <|n B AA ^^^ B]. 

Proof We distinguish two cases: Case 1: A G EXP and Case 2: A ^ EXP. In the 
first case, we will show that if no such B exists, then A G NP fl coNP. In the second 
case, we will show that if no such B exists for our A, then in fact A G EXP, thus 
generating a contradiction to A ^ EXP. 

Case 1: Suppose A G DTIME[2" ] for some constant k. Our set B, as finally 
constructed, will satisfy the following condition. 

Condition 3.2 For each x G S*, 

1. xeA-^ {i3y)[\y\ = Ix]'^ A {x,y, 1) E B] A i^y')[\y'\ = M" A {x,y',2) G B]) , 
and 

2. x^A^ [{MM = kl' A (x,i/, 1) G 5] A {M)[\y'\ = kl^' A (x,i/',2) G B]). 

A subset of S* is identified with its characteristic sequence according to 
lexicographic order. The n-segment, 5^", of a set B is defined to be the initial 
segment of this sequence including all words of length less than n. 



A set B satisfying Condition |3.2| is called admissible. Each initial segment of an 
admissible set is also called admissible. A set C is called a consistent extension of an 
admissible initial n-segment / if C is admissible and C^" = /. 
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For each B satisfying Condition p.2| , it clearly holds that A <|^ B. We will define 
B in such a way that no NP machine with three final states — ace, rej, and ? — can 
robustly strong-reduce A to B. Assume a list L of acc/rej/?-final-state NPTMs 
created by pairing every acc/rej/?-final-state nondeterministic Turing machine with 
every clock of the form n^ + k, k > 0. Note that each n'^ + /c is a monotonically 
increasing function on the natural numbers. Initially, i = 1, n = 0, and B"^^ = 0. 
Note that this is admissible. Suppose now i > 1, and that B has been determined up 
to i?^", and that 5"^" is admissible. 

Stage i Let N be the ith machine on the list L. Let p be the polynomial of the 
(clearly attached) clock that (for all oracles) upper-bounds the running time of N. 
Define Hq to be the smallest number m > n such that: 

(3.a) (V6 G {l,2})(Vx,i/ G J:*)[{\{x,y,b)\ > m A \y\ = \x\') ^ p{\x\) < 2^'']. 

Extend i?^" to an admissible segment B^"'°. (This can always be done, as the very 
fact that 5^"^ is an admissible n-segment implies that there is an admissible set B of 
which it is a prefix, so the no-segment of that set B is an extension of 5"^" and must 
also be admissible.) 

Now we consider the following question. (Recall that we have defined above the 
notion of a consistent extension of an admissible initial segment.) 

Question 3.3 Is there a consistent extension C of B^"'° such that either (3x G 
A)[N'-'{x) has a rejecting computation] or (3a; ^ A)[N'^{x) has an accepting 
computation] ? 



If the answer to Question |3.3| is "yes," then we fix such an extension C for the 
lexicographically smallest applicable x, determine m hj m = maxjrao + l,p(|x|)}, 
and extend B^"'° to i?<™, which is chosen to be the m-segment of C. This choice of 
the extension preserves all rejecting paths (if the first case of Question |3]^ occurs) 
and all accepting paths (if the second case of Question ^]3| occurs). If the answer to 



Question 3^ is "no," then nothing further will be done in Stage i. Notice that we do 
not claim that the answer to Question ^^ is recursively computable. However, this 
is not a problem, as Theorem pTl] does not require B to be recursive. 



Clearly, Question ^]3| is answered "yes" infinitely often. (L, as any reasonable 
enumeration of Turing machines does, contains infinitely many machines N such that 
for all oracles C, L{N'-^) <^ A or Lrej{N'^') 2 A.) Since Question ^]3|is answered "yes" 
infinitely often, clearly the length to which B is constructed increases unboundedly. 
Thus B, as finally constructed, is admissible (and not a finite initial segment). Since 
B is admissible, it follows that A is strongly reducible to B. 

It remains to show that A is not robustly strong reducible to B. We prove this 
by contradiction. Suppose A <^^ B via some machine A^ from list L. (If A <^^ B 



via some machine not on list L then certainly A <^^ B via some machine on L, 
so the assumption that A^ is chosen from L can be made without loss of generality.) 
Let p be the polynomial enforced by the clock of machine N\ recall that this is a 
monotonically increasing polynomial that, independent of the oracle, upper-bounds 
the running time of N . Assume that N was considered in Stage i and let i?<"-o be the 
initial segment of B that was constructed at the beginning of Stage i as admissibly 
extended as described right after Equation |3.a| . We prove the following claim. 
Claim If A <^^ B (where B is as just constructed), then A G NP fl coNP. 

We will describe an NPTM M that witnesses the membership A G NP fl coNP. 
The machine M remembers the finite initial segment B^"^". On each input x, M will 
simulate without an oracle the computation of A^ on x using a certain oracle that 
actually depends on x. 

For each x, let the integer m^ be defined by 

k 

m^; = max{ra I 2" <p(|a;|)}, 

and let 

B, = 5<"° U {(a;',0l"'l',l)||(x',0l"''',l)| >noA|a;'| <m,Aa;'Gv4} 
U {{x', 0l"'l', 2) I I (a;', qI"'!", 2)| > no A \x'\ < m, A x' ^ A}. 

Now we describe M. On input x, M simulates N^^'lx), where queries are handled 
as follows: Short queries (i.e., of length < no) are answered directly by the finite 
set S^"". Each other query is answered "no," unless it is of the form (x', O'^'' , 1) or 
{x',0'^ ' ,2), where \x'\ < m^. For each such query, use the EXP algorithm for A to 
determine membership of x' in A. This algorithm runs in time at most 2'^ ' < p(|x|), 
since \x'\ < m^. li x' E A then answer "yes" to (x', O'^ ' ,1) and answer "no" to 
(x', O'^ I ,2). li x' ^ A then do exactly the opposite. 

This shows: 

M runs in nondeterministic polynomial time and, for each x, simulates 
the work of A^-^^ (x) . 

Since we assumed that A^ is robustly strong, it follows that, for all x and for all 
oracle sets, A^ on x using the oracle yields either some accepting computation and no 
rejecting computation, or some rejecting computation but no accepting computation. 
This is true even though the oracle B^ used by A^ depends on A^'s input, x. Thus 
the only issue is whether the decision made along each accepting or rejecting path is 
correct. 

Suppose some accepting or rejecting path is incorrect. Thus, for some x, either 
X G A and yet some path as described above rejects, or x ^ A and yet some path 
as described above accepts. However, for this particular x and a particular such 
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path we can extend i?<"o (in fact, can extend Bx in light of the comments later in 
this paragraph regarding the pairing function) consistently in such a way that such 
a rejecting or accepting computation path is preserved. The key^ point is that the 
number of queries is at most p(|a;|), which is strictly less than 2'^' , the number of 
available j/'s for any x with |5;| > rrix. To claim that all these |/'s are actually available, 
we note that we are assuming certain properties of the pairing function, namely, that 
if \a\ = \a'\, \b\ = \b'\, c E {1,2}, and c' G {1,2}, then |(a,6,c)| = \{a',b',c')\. We 
also assume, as is standard, that if one increases the length of any one input to the 
pairing function the length of the output does not decrease. We do not require that 
the pairing function be onto, though we do require it be 1-to-l. Thus, a consistent 
extension of B^ can be found that preserves the particular path. 

However, if that is the case, then the answer to the initial question. Question |3.3| , 
during the construction of B must have been "yes," and the construction of B would 
have explicitly ruled out the possibility that the machine N accepts A with oracle B. 
This contradicts our supposition regarding there being some incorrect path. Thus, it 
must be the case that for all x the described computation of M is such that (a) if 
X E A then some path accepts and no path rejects, and (b) ii x ^ A then some 
path rejects and no path accepts. This is a proof that A G NP fl coNP. Thus our 
assumption (for the current case — A G EXP) that the B constructed does not satisfy 
Theorem |3.1| leads to a contradiction, as in fact A ^ NP fl coNP. This concludes the 
proof of Case 1 {A E EXP). 

Case 2: Suppose A ^ EXP. The proof structure is as follows: Similarly to Case 1 we 
construct a set B such that A <^ B. However, if A <^^ B then we show that this 
implies that A E EXP, yielding a contradiction to A ^ EXP. 



We require that B satisfy Condition 3.2 for A; = 1 



X E A — > {(3y)[\y\ = \x\ A {x,y,l) E B] A {^z)[\z\ = \x\ A {x,z,2) E 5]), and 

x^A—^ {{MM = kl A (x,i/, 1)eB]A {3z)[\z\ = \x\ A (x, z, 2) G B]). 

The construction of B is as in Case 1. Thus we get an admissible B, and hence 
A <f B. 

The crucial claim is the following: 
Claim: If A <^^ B then A E EXP. 

Let us assume A <^^ B via N. For reasons analogous to those discussed in 
Case 1, we may without loss of generality assume that A^ is chosen from the list L. 
Let p be the (nondecreasing) polynomial clock upper-bounding, independent of the 
oracle, the running time of A^. Assume that A^ was considered in Stage i and let i?<"o 
be the initial segment of B that has been constructed at the beginning of Stage i and 



admissibly extended as described right after Equation |37a . 
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For each x, let the integer rrix be defined by 

rrirc = inax{n | 2" < p(|x|)}. 

Note that nix = C'(log |a;|), and an upper-bound on the constant of the O can be seen 
immediately given the polynomial p. For each x, let 

Bx = 5<"« U {(x',Ol^'l,l)| |(2;',0l^'l,l)| >noA|a;'| <m^Ax'e A} 
U{(x',0l^'l,2)| |(a;',0l^'l,2)| >noA\x'\ Km^Ax' ^A}. 

We will describe a deterministic computation that for any given x simulates N^'^i^x). 
For a given x, the algorithm either will use table lookup or will examine 2^'^^^^'' 
nondeterministic paths of N{x) in turn. 

Since irtx = 0{\og\x\), there are at most a finite number of inputs x for which 
\x\ < rrix- On input x, if |x| < m^ then use finite table lookup to determine the 
correct answer. Now suppose |a;| > m^. 

Let p'{n) = p{n) + n^. Then p'{n) > p{n), p'{n) > r? and, like pin)^ p'in) is 
monotonic increasing. We will inductively assume that for all x' such that \x'\ < \x\, 
"x' G A7" can be decided in time 2^^^^ I). Upon input x, \x\ = n, we first compute 
Xa{x') for all \x'\ < \x\. This takes time at most X]r=o^ 2*2^ (*\ which is bounded by 
2P (n-i}+n^ j^y |-]^g £g^j,|. ^j^g^^ p jg ixionotonic and thus this is a geometric series. Next we 
write down p{n) bits, as nondeterministic moves of N{x). We will cycle through all 
such p{n) bits. For a particular sequence oi p{n) bits, we simulate the computation of 
A^ on X as follows: Whenever N{x) makes a query q of length less than no, we answer 
it according to i?^"". If a query q has length \q\ > uq, and is of the relevant form 
{x', O'^ ', 1) or {x', O'^' ', 2), and |x'| < nix (note that this implies that |x'| < nix < \x\), 
then we answer according to xa{x')- For all other queries, the answer is "no." Thus, 
the computation for x with |x| = n takes time at most 

2p'(n-l)+n_^2P(")p(n). 

We have p{n) < 2^ since n = \x\ > rrix- It is easy to verify that p{n) + n < p'{n) — 1 
as well as p'{n — 1) + n < p'{n) — 1, by the definition of p'{n), and the monotonicity 
of p(n). Thus the time taken to simulate the computation of A^ on x is at most 2^ ^^\ 
completing the induction. This completes the proof of the Claim, namely A G EXP, 
and thus we reach a contradiction in Case 2. 

The proof of Theorem p.l| is complete. □ 

Now we prove the main claim of this section. 

Theorem 3.4 (V recursive A ^ NP fl coNP)(3 recursive B)[A <|n BAA ^'^^ B]. 
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Proof For an initial n-segment I we define X * I = [X \ X^") U /. We make the 
following three preliminary claims. As they are clear, we state them without proof. 
Claim 1: For each initial segment I: If A <^ B and C = B * I, then A <^ C . 
Claim 2: Let A and B he chosen according to Theorem \3.1\ and let C = B * I for 
some initial segment I. Then every machine N strongly reducing A to C must fail to 
be strong for some extension E of I . 

Claim 3: Every admissible initial segment I has a consistent extension C such that 
A <^ C, but no machine reducing A strongly to C is strong for all extensions of I . 

Now we prove Theorem |3.4| . We modify the construction of B. Let us assume 
that at the beginning of Stage i the admissible initial segment I is available as the 
result of the previous steps. Let the machine N be considered in Stage i. 

We check by a systematic search whether 

(1) there exists a finite initial segment that is an admissible extension of / that 
witnesses that A is not correctly reduced to this extension by A^ (recall that 
the definition of an admissible initial segment means each such initial segment 
is an initial segment of some admissible set), or 

(2) there exists a finite initial segment that is an extension of / that witnesses that 
N fails to be strong using this extension as its oracle. (Here we can allow even 
inadmissible extensions.) 

Call these two cases type-1 and type-2. If a type-1 extension is found first, then 
extend B in an admissible way to preserve a computation witnessing a contradictory 
computation (i.e., an accepting path ii x ^ A, and a rejecting path if x G A). If a 
type-2 extension is found first, then nothing is done in this stage. 
Claim: One of the two cases must happen. 

Let A^ be strong for all extensions of I. Since / is admissible. Claim 3 yields an 
admissible C such that A <^ C, but no machine strongly reducing A to C can 
be robustly strong for all extensions of /. Since A^ is strong for all extensions of J, 
from Claim 3 we can conclude that A^ does not strong-reduce A to C. So A^ does not 
reduce A to some particular finite initial segment of C (one long enough to witness 
the non-reduction of A to C via A^). Thus a type-1 extension will be found unless a 
type-2 extension is encountered sooner. 

Suppose now that A^ is not strong for some extension of /. Then this will become 
apparent at some finite length for some (not necessarily consistent) finite extension 
of / on some input. Hence a type-2 extension is found unless a type-1 extension is 
found sooner. This modification of the construction of B shows that B is the union 
of a growing sequence of effectively constructed finite initial segments. Thus, B is 
recursive. □ 

More generally, the proof actually shows that a B recursive in A can be found to 
satisfy the theorem. 
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One can ask whether the difference of <^ and < ^^ is so strong that the following 
statement holds: (V recursive B ^ NPncoNP)(3 recursive A)[A <f^ BAA ^^^ B]. 
This can be reformulated in terms of reducibility downward closures: (V recursive B ^ 
NP n coNP)[R!^S(5) / R|^(5)]. However, this claim is false. Intuitively, if B is 
chosen to be of appropriately great structural richness, the differences between the 
two reductions may be too fine to still be distinguishable in the presence of B. For 
instance, if B is an EXPSPACE-complete set, and thus is certainly not contained in 
NP n coNP, then for every A e Rf{B) = NP^ n coNP^ = EXPSPACE we have 
A<P^B and hence A <^^ B, i.e., R|^(S) = R^^{B). 

4 Comparing the Power of the Reductions 

Long |T^ proved that strong and Turing polynomial-time reductions differ. More 
precisely, he proved the following result. 

Theorem 4.1 /^ (V recursive A^F){3 recursive B)[A <^^ B A A ^^ B]. 

Consequently, at least one of the edges in Figure 1 must represent a strict inclusion. 
Indeed, we can show that strong reductions differ from both overproductive and 
underproductive reductions. 

Theorem 4.2 

1. (3 recursive A){3 recursive B)[A <^ BAA ^° B]. Indeed, we may even 
achieve this via a recursive sparse set B and a recursive tally set A. 

2. (3 recursive A){3 recursive B)[A <|^ BAA ^5^ B]. Indeed, we may even 
achieve this via a recursive sparse set B and a recursive tally set A. 

Proof For a given set B define A (implicitly, Ab) by 

(4.b) A = {0^\{3y)[\y\=tA{0\y,l)eB]}. 

B is constructed by diagonalization, and we make sure that 

(4.c) (Vz)(3 exactly one u G {0, 1})(3 exactly one y)[{0\y,u) e B A \y\ = i]. 



Assume that B has the property of Equation ^^ and that A is defined by Equation [4.b| . 



Then A strongly reduces to B via a machine A^ that is described as follows (this is 
simply making explicit what is implicitly clear from Equation [4.b| ): 

An input x is rejected if it is not an element of {0}*. Otherwise, x is an 
element of {0}*, say x = 0*. Then A^ nondeterministically generates all y 
such that \y\ = i, and using the oracle B, for each y and m G {0, 1}, it finds 
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out whether (0*, y, u) E B. K path accepts if on this path (0*, y,l) E B is 
determined, and it rejects if {0^,y,0) G i? is determined. In all remaining 
cases, the path is a no-comment (i.e., ?) path. 



By Equation ^^ , on each input N reaches on exactly one path the correct answer to 
the question of whether x E A, and all remaining paths are no-comment paths. 

For the construction of B we assume an effective enumeration, E, of all 
nondeterministic polynomial-time oracle machines. B is constructed to be the union 
B = W^^Bi, where Bi is determined (in a recursively computable way) in Stage i 
of the construction, and Bq ^ Bi C B2 ^ . . . are finite initial segments of B. This 
ensures that B is recursive, which ensures that A also is recursive. Set Bq = (/} and 
let i initially equal 1. As a formal choice to avoid problems in Stage 1, we act as if 
the "n" of Stage were —1. 

Start of stage construction 

Stage i. Let M be the ith machine in our enumeration E. Let the polynomial p be 
a bound on the computation time of M. Choose n sufficiently large (so large that 
the lengths of all queries occurring in all previous stages are less than n and that 



p{n) < 2"'). To help maintain Equation |4.c| we will do some coding now. For each n 



that is strictly less than the n we just set, but strictly greater than the n that was set 
in Stage i — 1, put into B exactly one as-yet-untouched string of the form: (0", w, b), 
with |w| = n and 6 G {0, 1}. Such strings can be found (as, by our choice of the n of 
Stage i — 1, the simulation we ran during Stage i — 1 cannot touch enough strings to 
prevent this). 

Let X = 0". 
Case 1: M^^-^{x) has a rejecting path. We choose one such path a and freeze it, 
i.e., we make sure that all queries answered negatively on a must remain outside of 
all the Bj. There exist 2" triples of the form (0"",?/, 1) where \y\ = n, but only p{n) 
can occur on a. Thus, for some z for which (0", z, 1) is not queried on a, we set 
Bi = -Bj-i U {(O", z, 1)}. Note that Equation ^^ is maintained at this length. 
Case 2: M^^-^{x) has an accepting path. In this case we freeze an accepting path 



and put some (0",t(;,0) in B. Note that Equation ^^ is maintained at this length. 
Case 3: M^^-^{x) has only no-comment paths. Note that M is in this case clearly 
not robustly overproductive. Add to B exactly one string of the form: (0", w, b), with 
\w\ = n and b G {0, 1}. Note that Equation ^^ is maintained at this length. 
End of stage construction 

Assume A <^ B via machine M, and let i be such that this machine was 
considered in Stage i. Let n be the input length chosen in Stage i and let x = 0". Let 
us consider the implications based on which of the three cases applied to M^^-^{x). 
If Case 1 held, a rejecting path a was frozen, and thus, since later stages will not 
interfere, a in fact will be a rejecting path of M^{x). By adding (0",z, 1) to B, we 
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obtained x G A by Equation [4.b[ There are two cases: 

1. M^{x) has no accepting path. 

2. M^{x) has at least one accepting path. 

In the former case, L{M^) ^ A, since x G A, but M^ does not accept it. In the latter 
case, M^ on input x fails to be strong, but this is impossible because M reduces A 
strongly to B (by the assumption that A <^ B via M). Case 2 is analogous. If 
Case 3 happened, then M is not robustly overproductive, so A <§ B is certainly not 
implemented by M. 

So, in all three cases, M does not reduce A to -B in the sense of <^ • So, due to 
our stage construction, we have that A ^^ B. This completes the proof of Part |]. 

The proof of Part |^ of the theorem is very similar to that of Part |l|, so we simply 
briefly sketch the differences. At the start of Stage z, where one sets the n that will 
be used in Stage i, we choose n so large that it not only satisfies the conditions used 
in Part ^ but also so large that the "Party Lemma" applies (see below). The three 
cases of Part |I] are then replaced by the following argument flow. If there is any 
length n string y for which either 

1. M*-^'"^^'^°"'^'^'^(x) does not both have at least one accepting path and no 
rejecting paths, or 

2. M*^^'-i^^°"'^'°^)(x) does not both have at least one rejecting path and no 
accepting paths, 

we are easily done, via adding the obvious string to taint the reduction. On the other 
hand, if for each length n string y we have that 

1. M*^^'"^^^°"'^'^^^(x) has at least one accepting path and no rejecting paths, and 

2. M(^*-i^*>''"'^'°^)(x) has at least one rejecting path and no accepting paths, 

then (again, assuming n was chosen appropriately large) by the "Party Lemma" (|^ 
page 104]) there exist strings y and y' (possibly the same string) of length n such 
that M^'-i'-'^°"'^'°^'-^^°"'^ '^^(x) has both accepting and rejecting paths, and thus the 
machine considered at Stage i in fact is not robustly underproductive. (Of course, 
we do not in this case add both (0",^, 0) and (0",?/', 1) to our oracle as this would 
taint the promise of Equation |4.4 Rather, the very fact that some oracle causes 
overproductivity is enough.) So, in this case, we add any single coding string of the 



form (0*^, y'\ b), with b G {0, 1} and \y"\ = n, to maintain Equation ^^ , and we move 
on to the next stage. □ 

Next we consider the relationship between <^ and <^^. Let M be an NPTM. 
By interchanging the accept and the reject states of M we get a new NPTM machine 
N such that Lrej{M) = L{N). If M is robustly strong, we have L(M^) = L{N^) 
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for every oracle A. The pair (M, A^) is what Hartmanis and Hemachandra |p call a 
robustly complementary pair of machines. For such a pair, the following is known. 

Theorem 4.3 j^ If (M,N) is a robustly complementary pair of machines, then 

(VA)[L(M^) gP^^^®^]. 

Gavalda and Balcazar [^ noted that, in view of the preceding discussion, one gets 
as an immediate corollary the following. 

Corollary 4.4 Ql {^A,B)[A <^^ B — > Ae pSATeB] 

In fact, the proof of Theorem ^^ still works if M is an underproductive machine 
reducing Aio B. Thus, we have the following. 

Theorem 4.5 {\/A,B)[A <^ B — > A G pSAT®B], 



Not only is the proof of Theorem ^]3| not valid for <^ , but indeed the statement 
of Theorem [4.5| with <Jp replaced by <^ is outright false. This follows as a corollary 
to a proof of Crescenzi and Silvestri 0, Theorem 3.1] in which they give a very nice 
application of Sperner's Lemma. 

Theorem 4.6 (3A, E)\A <^ EAA^ pSAT®i?]^ 

Proof The proof follows from a close inspection of the proof of |^, Theorem 3.1]. 
Crescenzi and Silvestri prove the existence of a S*-spanning pair (A^o? ^i) of machines 
and the existence of an oracle E with the property that (V 0-1 valued function / G 
FP ® )(3x)[x L^Nfr^-.)]. We need some preliminaries. The standard 
triangulation of size n is the triangle. A, in a Euclidean x, ?/-plane with the corners 
A = (0,0), -B = (n — 1,0) and C = (0,72—1) that is triangulated by the lines 
X = i,{i = 0, . . . ,n — 2),y = i,{i = 0, . . . ,n — 2) and x + y = i,{i = 1, . . . ,ri — 1). The 
vertices of this triangulation are exactly the points {i-,]) with natural i and j, and 
i + j <n — 1. A coloring of the standard triangulation is a mapping that associates 
with each vertex one of three given colors, 1, 2, and 3. Such a coloring is called 
c- admissible if the vertices on the border of A satisfy a certain condition pair, namely 
the following. 

1. A, S, and C are colored 1, 2, and 3 respectively. 

2. If P is a vertex on a side joining the corners colored i and j, then P must be 
colored by i or j. 

Sperner's Lemma guarantees that each c-admissible coloring of a standard 
triangulation contains at least one three-colored triangle. 

A standard triangulation of size n has ^^^^ — - vertices. So a coloring can be encoded 
by n{n+ 1) bits, since a color can easily be encoded using two bits. If In is the smallest 
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natural number / such that n(n + 1) < 2', and if a certain ordering of the vertices of A 
is fixed, for instance (0, 0), (1, 0), ... , (n-1, 0), (0, 1), (1, 1), ... , {n-2, 1), . . . , (0, n-1), 
then a coloring certainly can always be encoded by the first n(n + 1) bits of a word 
of length 2'", which means by a subset U of {0, 1}^". In order to recover the coloring 
from U, assume {0, 1}^" to be ordered in the usual lexicographic way — O'" < 0'"~^1 < 
. . . < V" — and determine the values of the characteristic function of U for the first 
n{n + 1) words. So, the first two values determine the color of (0,0), the next two 
values determine the color of (1,0), and so on. 

Let Sn = max{/i; | k{k + 1) < 2"}. Now the nondeterministic oracle machines A'"o 
and A^^i are defined in such a way that for arbitrary oracle C and input x: 

1. Nq{x) has accepting paths if and only if CflS'^l encodes a coloring of a standard 
triangulation of size s\x\ containing a 3-colored triangle. 

2. N^{x) has accepting paths if and only if C fl S'^' encodes a non-c-admissible 
coloring of a standard triangulation of size S|^|. 

Clearly, both machines work in polynomial time. We define a new machine N 
that, on input x, nondeterministically transfers the input to both A^o and A^^i and 

1. On a given path simulating a path of A^^i, A^ ends in the state ace if A^^i accepts 
and otherwise ends in the no-comment state. 

2. On a given path simulating a path of A^o^ ^ ends in the state rej if A'^q accepts 
and otherwise ends in the no-comment state. 

By Sperner's Lemma, (A"o,A'^i) is a robustly I]*-spanning pair, and this means that 
A^ is robustly overproductive. 

The oracle E is defined by diagonalization such that for the ith deterministic 
polynomial-time oracle machine Tj and a suitably chosen rii it holds that: 

1. Tj ® (0*^') = 1 and E fl S"' encodes a c-admissible coloring of a standard 
triangulation of size Sm , or 

2. Tj ® (0"') = and E fl S"' encodes a coloring of a standard triangulation of 
size Sm without three-colored triangles. 

The crucial point is that E is in fact constructed in such a way that it does not 
encode colorings that both contain a three-colored triangle and are non-c-admissible. 
The fact that such an E can be constructed follows from |p. Remark 1] . This has the 
important consequence that A^ with oracle E is strong. Thus, defining A = L{N^), 
we have A <^ E via N, since A^ is robustly overproductive. Finally, we observe that 
A ^ pSATffiB_ Why? If not, then we have some Ti with A = L{T^^^®^) = L{N^). 
However, from the definition of A^ and E (in particular in the stage where Tj was 
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considered) we conclude 0"" G L{T^^^®^) < — > 0"» ^ L{N^). This contradiction 
shows A ^ pSATffii?_ □ 

As mentioned earher, Theorem O follows from the proof of |^, Theorem 3.1], but 



not from the theorem itself. 

The preceding two theorems have the consequence of showing a deep asymmetry 
between <^ and <^. This asymmetry — that <° 7^ <^ , yet to prove the analog 
for <!^ would resolve the P 7^ NP question — contrasts with the seemingly symmetric 
definitions of these two notions. We now turn to some results that will lead to the 
proof of this asymmetry. 

Theorem 4.7 Overproductive and underproductive reductions differ in such a way 
that 



Proof By Theorem ^^ we have sets X and Y such that 

X <? FAX^PSAT®^, 



and because of Theorem [4.5| for these sets the statement 

is true. The conjunction of these two statements is equivalent to 

X<^YAX^}^YAX^ pSAT®y^ 
from which we conclude <!^ ^ <i^ • D 



An immediate consequence of Theorem [4.7| is the following. 
Theorem 4.8 <^^ ^ <°. 



We conjecture that Theorem |4.8| can be stated in the much stronger form of 
Theorem |3.4| , where <^ is replaced with <^. From Theorem O, it follows that 



<° 7^ <!^. It is interesting to note that, although we know that <° and <!^ 
differ, it may be extremely hard to prove them to differ with a sparse set on the 
right-hand side. More precisely, we have the following. 

Theorem 4.9 {3B G SPARSE) [R°(fi) ^ R^B)] — ^ P ^ NP. 

Proof Assume P = NP and A <^ B with a sparse set B. This certainly 
implicitly gives a robustly S*-spanning pair {No,Ni) of machines and, say, A = 
L{Nf). By [|, Theorem 2.7], there exists a 0-1 function b G FP^"^"^®^ such that 
(\/x)[x G L(A^w^-))]. Since N is strong for B, the sets L(Nq) and L{N^) are disjoint. 
Hence x G L{N^) if and only if x ^ L{Ni), from which we conclude 

X & A < — > b{x) = 1. 



From the assumption P = NP, it follows that b G FP and thus A <!^ B. □ 

The fact <° 7^ <^, stated above, sharply contrasts with the following. 

Theorem 4.10 <^ ^ <?. — > P j^ NP. 



Proof Assume P = NP and A <J^ B. By Theorem^ we have A G pSATes^ g^^^ 



because of our P = NP assumption, this means A <^ B. □ 



Theorem |4.10| strengthens in two ways the statement, noted by Gavalda and 
Balcazar 0, that if <J^^ differs from <^ anywhere on the recursive sets then P 7^ NP. 
In particular, we have these two improvements of that statement of Gavalda and 
Balcazar: (a) we improve from <^^ to <^ , and (b) we remove the "on the recursive 
sets" scope restriction. 

Below, we use X <^ Y to denote that it is not the case that X ^ Y. 



Corollary 4.11 




1. <¥ ?^ <? - 


-^P^NP. 


2. <u ^ <RS _ 


-^P^NP 



Proof By Theorem |O0|, P = NP implies <;^ = <p and thus <;^ C <o. In 



light of Theorem [4.7| , we even have <t ^ — t ■ '-' 

So proving <!^ 7^ <t , <x 7^ — t^ ' *^^ — t '^ — t amounts to proving 



P 7^ NP. In particular, we cannot hope to strengthen Theorem p.4| so that it is valid 



for <^ rather than <^ . 

Although we know that <!^ ^ <!^, it is also difficult to show that they differ 
with respect to a sparse set on the right hand side, because we have 

{3B G SPARSE) [R0(5) 2 RJ^(5)] — ^ P ^ NP, 

which is a consequence of Theorem O . 
Theorem 4.12 

i- <T^ 7^ <T — ^ P 7^ NP. 

2. <^s = <p — . p = NP n coNP. 

Proof Let P = NP. Then from A <^^ B we have, by Corollary g^, A G pSATes = 
P^, i.e., A <Jj- B. If <T^ = <T 5 then their zero degrees coincide, so P = NP fl 
coNP. D 
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5 Overproductive Reductions and the Classic 
Hardness Theorems 

The polynomial hierarchy is defined as follows: (a) Sg = P; (b) for each i > 0, 
Ef+i = NP^^ (c) for each i > 0, Hf = {L | I e Sf}; and (d) PH = Ui>o^f [gg. 
02 = {L\ L <^^ SAT} (see ||2^), where <{'t denotes polynomial-time truth-table 



reduction. ZPP denotes expected polynomial time [§]. It is well-known that NP C 
QP ^ pNP ^ 2PPNP c S^. 

It is very natural to ask whether the existence of sparse hard or complete sets 
with respect to our new reductions would imply collapses of the polynomial hierarchy 
similar to those that are known to hold for <!^. That is, are our reductions useful 
in extending the key standard results? To study this question, we must first briefiy 
review what is known regarding the consequences of the existence of sparse NP-hard 
sets. The classic result in this direction was obtained by Karp and Lipton, and more 
recent research has yielded three increasingly strong extensions of their result. 

Theorem 5.1 1. Hl^ NP C RP (SPARSE) — ^ PH C S^. 

2. (implicit in j\l^, see / [7^/ and the discussion in ^T^J; explicit in /p|,[7^/j NP C 
R?S(SPARSE) — ^ PH C S^. 

5. JH/ NP C R^Sj^SPARSE) — > PH C ZPP^^. 

4-1^ If A IS self-reducible and A e (NP^ n coNP^)/poly, then ZPP^^^ C 

2ppNpB 

5. Pm If A has self-computable witnesses and A E (NP n coNP )/poly, then 
2ppNpA^2PpNP^. 



We mention that Kobler and Watanabe |TB[ state part ^ in the form NP C (NP fl 
coNP)/poly — > PH C ZPP , which is equivalent to the statement of part |^ in light 
of Theorem p^ . Both part H and part H extend part |[ 

It remains open whether parts ^, ^, or |^ of Theorem 5T can be extended from 



robustly strong reductions to overproductive reductions. However, as Theorem ^ 



we 



extend part |^ of Theorem ^]1] to overproductive reductions. As a consequence, there 



is at the present time no single strongest theorem on this topic; Theorem 5.2 seems to 



be incomparable in strength relative to either of the final two parts of Theorem |5Tl . 
Theorem 5.2 NP C RO(SPARSE) — > PH C S^. 



Proof Our proof will in effect extend the approach of Hopcroft's |Tl[] proof of the 
Karp-Lipton Theorem (Theorem ^.1|, part |^) in a way that allows the proof to work 



even when the machine involved is one implementing an overproductive reduction. 
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We will centrally use the fact that such machines are also underproductive for the 
specific set to which the reduction maps. 

Assume NP C R^ (SPARSE). Then there is a sparse set S such that SAT <§ •S', 
and let M be a machine certifying the reduction. That is, NPTM M is robustly 
overproductive, M^ is underproductive, and SAT = L[M^). Let ps bound the 
sparseness of S*, i.e., for each m, \\S-^\\ < psim). 

Let L be an arbitrary Ilg set. So for some NPTM A^ we have L = L^N^^"^). 
We will describe a Sg algorithm for L. Say the runtime of A^ (respectively, M) is 
upper-bounded (without loss of generality, for all oracles) by p^- (respectively, Pm)- 
Our S2 algorithm will be implemented by an NPTM A^ with SAT as its oracle. Since 
SAT is NP-complete, we will act as if A^ had two different NP sets {A and B, defined 
below) as its oracle; implicitly, each when called is implemented via a reduction to 
SAT. _ 

We now describe A^. For each y that is a boolean formula with at least one 
variable, let i/t denote y with its first variable set to true, and let yp denote y with 
its first variable set to false. Let the function "coding" be such that given any finite 
set R, coding(i?) is a standard, easily decodable encoding of R. For a computation 
path p (of some NPTM implementing an overproductive reduction), let outcome(p) 
denote the outcome of the path p (which will be one of ace, rej, or ?). On input x, 
\x\ = n, N nondeterministically guesses each subset, i?, of Y.^PMiPN{n)) containing at 
most PsiPMipNiji))) elements. A^ then asks (x, coding(i?)) to the NP set A imphcitly 
defined by the following, (x, H) E Aii and only if there is an _R, with H = coding(i?) 
such that, for each string y satisfying \y\ < Pn{\x\), the following conditions hold: 

1. if y is a legal formula with at least one variable then 



(Vpi 

(Vp2 
(VP3 



Pi is a path of M^{y) and outcome(pi) G {ace, rej}) 
P2 is a path of M^{iit) and outcome(p2) £ {ace, rej}) 
Ps is a path of M^lyp) and outcome(p3) G {aee, rej}) 



[outcome (pi) = aee <^=^ outcome (P2) = aee V outcome (pa) = aee], and 

2. if 1/ is a legal formula with no variables then 
(Vp : p is a path of M^{y)) 
[(y = true =^ outcome(p) 7^ rej) A {y = false =^ outcome(p) 7^ aee)]. 

Crucially, note that for each x it will hold that for at least one R the query 
(x, CO ding (i?)) that A^ asks will be such that (x, coding(i?)) ^ A. For each R 
satisfying (x, coding(i?)) ^ A, note that by the definition of A we have that 
(a) M^{y) is underproductive for all y satisfying \y\ < j9Ar(|x|), and (b) SAT-^'^*-"^ = 

(L(M^)j . (Additionally, recall that M is robustly overproductive.) The key 

point here is that if M^ actually overproduces (has both accepting and rejecting 
paths) on some y with \y\ < Pn{\x\), the test will be effected by this in such a way 
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that we will have (x, coding(i?)) G A. In particular, the set A is essentially, regarding 
internal nodes of SAT's disjunctive self-reducibility tree, testing that each triple of 
non-? outputs, one each from a node and its children, is such that the three outputs 
are consistent with a correct self-reduction; if a machine overproduces anywhere (in 
the range considered) it will fail this test. 

A^, on each guessed path (that is, each guess of R) that gets the answer 
(x, coding(_R)) G A simply rejects. A^, on each guessed path that gets the answer 
(x, CO ding (i?)) ^ A asks the query (x, coding(i?)) to the set B G NP, and accepts 
if and only if the answer to this query is (x, coding (i?)) ^ B. B is defined as 
follows, (x, H) G -B if and only if there is an R with H = coding(/?) such that 
nondeterministically simulating N^^^^ \x) yields at least one accepting path (of A^), 
where by "simulating" we mean simulating A^ and, each time an oracle call w is made 
to L{M^), nondeterministically guessing a path p' of M^{w) and (a) continuing the 
simulation of A^ with the answer yes (respectively, no) if the outcome of p' is ace 
(respectively, rej), and (b) halting and rejecting (on the current path — recall that A^ 
is a standard Turing machine whose paths thus each either accept or reject, and by 
definition the machine accepts an input exactly if there is some accepting path on 
that input) if p' has ? as its outcome. The crucial point here is that, for those R on 
which it is actually called on actual runs of A^, -B's use of R will correctly simulate 
SAT. 

We have shown that each 112 set has a Eg algorithm, and thus have proved our 
theorem. □ 

The above proof does not work for the case of underproductive reductions, and 
indeed it remains open whether Theorem ^.2| can in some way be extended to 
underproductive reductions. An analog for strong nondeterministic reductions is 
implicitly known, but has a far weaker conclusion. 

Theorem 5.3 (implicit m f^) NP C R|n (SPARSE) — > PH C ZPP^^. 



Proof We start out from Yap's theorem p3|] in its strengthened form found by 
Kdbler and Watanabe |§, namely, coNP C NP/poly — ^ PH C ZPP^a. The 
following two statements show that the theorem to be proved is simply an equivalent 
reformulation of Yap's theorem: NP C R|n (SPARSE) < — > coNP C R|n (SPARSE) 
and (recalling Theorem ^ coNP C R|N(SPARSE) — > coNP C NP/poly. □ 

In contrast with the above results regarding sparse hard sets for NP, in the case 
of sparse complete sets for NP we have just as strong a collapse for <|'^-reductions 
as we have for <!J.-reductions. 

Theorem 5.4 /|7|/ NP C R^n (SPARSE n NP) — ^ PH = 0^. 



Proof Kadin H proved: If there exists a set S" G NP n SPARSE such that 
coNP C NP , then PH = 02. This is equivalent to Theorem p.4| because coNP C 
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NP-^ is equivalent to NP C NP'^ n coNP'^, and this, in turn, is equivalent to NP C 
Rf'iS). D 

As mentioned earlier, we leave as an open problem whether one can establish 
the collapse PH C Sg (or, better still, PH C ZPP ) under the assumption NP C 
R|^ (SPARSE), or even under the stronger assumption that NP C RU (SPARSE). We 
conjecture that no such extension is possible. 



6 Conclusions and Open Problems 

We mention as open problems the issues of finding equivalent conditions for <!^ C 

Define the runtime of a nondeterministic machine on a given input to be the length 
of its longest computation path. (Though in most settings this is just one of a few 
equivalent definitions, we state it explicitly here as for the about-to-be-defined notion 
of local-polynomial machines, it is not at all clear that this equivalence remains valid.) 
Recall that we required that NPTMs be such that for each NPTM, N, it holds that 
there exists a polynomial p such that, for each oracle D, the runtime of N^ is bounded 
by p. Call such a machine "global-polynomial" as there is a polynomial that globally 
bounds its runtime. Does this differ from a requirement that for a machine N it 
holds that, for each oracle D, there is a polynomial p (which may depend on D) such 
that the runtime of A^^ is bounded by p? Call such a machine "local-polynomial" as, 
though for every oracle it runs in polynomial time, the polynomial may depend on 
the oracle. 

In general, these notions do differ, notwithstanding the common wisdom in 
complexity theory that one may "without loss of generality" assume enumerations 
of machines come with attached clocks independent of the oracle. (The subtle issue 
here is that the notions in fact usually do not differ on enumerations of machines that 
will be used with only one oracle.) The fact that they in general differ is made clear by 
the following theorems. These theorems show that there is a language transformation 
that can be computed by a local-polynomial machine, yet each global-polynomial 
machine will, for some target set, fail almost everywhere to compute the set's image 
under the language transformation. We write A =* B ii A and B are equal almost 
everywhere, i.e., if {A — B) U {B — A) is a finite set. 

Theorem 6.1 There is a function /jv : 2^* — * 2^* (respectively, fo : 2^* — > 2^* ) 
such that 

1. there is a nondeterministic (respectively, deterministic) local-polynomial Turing 
machine M such that for each oracle A it holds that Li^M"^) = fN^A) 
(respectively, Li^M"^) = fuiA)), and 
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2. for each NPTM, i.e., each nondeterministic global-polynomial Turing machine 
M (respectively, DPTM, i.e., each deterministic global-polynomial Turing 
machine M) it holds that there is a set ACS* such that L{M^) =* Jn^^) 
(respectively, L{M^) =* foiA)). 



Though this claim may at first seem counterintuitive, its proof is almost immediate 
if one is given f^ and fo, and so we simply give functions f^ and fn satisfying 
the theorem. In particular, we can use /Af(v4) = {x\ {3y)[{\y\ < log|x|) A {y is 
the lexicographically first string in A) A (32;)[|2;| = |x|'^' A xz E A]]} and foiA) = 
{x I (3|/)[(|?/| < log \x\) A {y is the lexicographically first string in A) A (32;)[(2; is one 
of the |x|'^' lexicographically smallest length |x|'^' strings in E*) A xz E A]]}. 

The difference between global-polynomial machines and local-polynomial 
machines in general mappings, as just proven, may make one wonder whether the 
fact that robust strong reduction is defined in terms of global-polynomial (as opposed 
to local-polynomial) machines makes a difference and, if so, which definition is 
more natural. Regarding the former issue, we leave it as an open question. (The 
above theorems do not resolve this issue, as they deal with language-to-language 
transformations defined specifically over all of 2^ , but in contrast a robustly strong 
reduction must accept a specific language only for one oracle, and for all others 
merely has to be underproductive and over productive, plus it must have the global- 
polynomial property.) That is, the open question is: Does there exist a pair of sets A 
and B such that A ^^^ B (which by definition involves a global-polynomial machine) 
and yet there exists a nondeterministic local-polynomial Turing machine N such that 
L[N^) = A and (VD C J]*)[N^ is both underproductive and overproductive]? 
Regarding the question of naturalness, this is a matter of taste. However, we 
point out that the global-polynomial definition is exactly that of Gavalda and 
Balcazar [^, and that part |^ of Theorem ^.6| , Gavalda and Balcazar's [0] natural 
characterization of robustly strong reductions to sparse sets in terms of the complexity 
class (NP n coNP)/poly, seems to depend crucially on the fact that one's machines 
are global-polynomial. 



On the other hand Theorem |5.2| , though its proof seems on its surface to be 
dependent on the fact that <^ is defined via global-polynomial machines, in fact 
remains true even if <^ is redefined via local-polynomial machines. The trick here is 
that we modify the proof to clock the key local-polynomial machine (implementing 
the overproductive reduction) with the clock that applies for the sparse oracle to 
which the reduction actually reduces it, and then in the simulations of the proof if we 
detect that a path is about to exceed that clock, we know that we are dealing with 
a bad oracle R, and so in our simulation of that too-long path we truncate the path 
and "cap" it with two leaves, one an ace leaf and one a rej leaf. This, in effect, rules 
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out that potential oracle, as it will seem to be overproductive. 
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